Parallel Hierarchical Affinity Propagation with MapReduce

The accelerated evolution and explosion of the Internet and social media is generating voluminous quantities of data (on zettabyte scales). Paramount amongst the desires to manipulate and extract actionable intelligence from vast big data volumes is the need for scalable, performance-conscious analytics algorithms. To directly address this need, we propose a novel MapReduce implementation of the exemplar-based clustering algorithm known as Affinity Propagation. Our parallelization strategy extends to the multilevel Hierarchical Affinity Propagation algorithm and enables tiered aggregation of unstructured data with minimal free parameters, in principle requiring only a similarity measure between data points. We detail the linear run-time complexity of our approach, overcoming the limiting quadratic complexity of the original algorithm. Experimental validation of our clustering methodology on a variety of synthetic and real data sets (e.g. images and point data) demonstrates our competitiveness against other state-of-the-art MapReduce clustering techniques

Feature Extraction Using Discrete Wavelet Transform for Gear Fault Diagnosis of Wind Turbine Gearbox

Vibration diagnosis is one of the most common techniques in condition evaluation of wind turbine equipped with gearbox. On the other side, gearbox is one of the key components of wind turbine drivetrain. Due to the stochastic operation of wind turbines, the gearbox shaft rotating speed changes with high percentage, which limits the application of traditional vibration signal processing techniques, such as fast Fourier transform. This paper investigates a new approach for wind turbine high speed shaft gear fault diagnosis using discrete wavelet transform and time synchronous averaging. First, the vibration signals are decomposed into a series of subbands signals with the use of a multiresolution analytical property of the discrete wavelet transform. Then, 22 condition indicators are extracted from the TSA signal, residual signal, and difference signal. Through the case study analysis, a new approach reveals the most relevant condition indicators based on vibrations that can be used for high speed shaft gear spalling fault diagnosis and their tracking abilities for fault degradation progression. It is also shown that the proposed approach enhances the gearbox fault diagnosis ability in wind turbines. The approach presented in this paper was programmed in Matlab environment using data acquired on a 2 MW wind turbine